It's a less specific version of "losing someone ground."
Losing what has been gained so far, can be in influence, in merits previously won.
